Contrastive Learning Based Multi-view Feature Fusion Model for Aspect-Based Sentiment Analysis
WU Xing1, XIA Hongbin1,2, LIU Yuan1,2
1. School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi 214122; 2. Jiangsu Key University Laboratory of Software and Media Tech-nology under Human-Computer Cooperation, Jiangnan Univer-sity, Wuxi 214122
Abstract Current aspect-based sentiment analysis methods typically extract sentiment features through dependency tree and attention mechanism. These methods are susceptible to noise from irrelevant contextual information and often neglect to model the global sentiment features of sentences, making it difficult to process sentences that implicitly express sentiment. To address these problems, a contrastive learning based multi-view feature fusion model for aspect-based sentiment analysis(CLMVFF) is proposed. First, graph convolutional networks are utilized to encode information in dependency graph, constituent graph and semantic graph. The global sentiment node is constructed in each graph to learn global sentiment features while introducing external knowledge embedding to enrich sentiment features. Second, contrastive learning is exploited to mitigate the negative influence of noise. Combined with the similarity separation, the sentiment features are enhanced. Finally, the dependency graph representation, constituent graph representation, semantic graph representation and external knowledge embeddings are fused. Experimental results on three datasets demonstrate that CLMVFF achieves the improvement of performance.
Fund:National Natural Science Foundation of China(No.61972182)
Corresponding Authors:
XIA Hongbin, Ph.D., professor. His research interests include personalized recommendation and natural language processing.
About author:: WU Xing, Master student. His research interests include natural language processing and deep learning. LIU Yuan, Ph.D., professor. His research interests include network security and social network.
[1] TANG S Y, CHAI H Y, YAO Z Y, et al. Affective Knowledge Enhanced Multiple-Graph Fusion Networks for Aspect-Based Sentiment Analysis // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2022: 5352-5362. [2] CHEN C H, TENG Z Y, WANG Z Q, ,et al. Discrete Opinion Tree Induction for Aspect-Based Sentiment Analysis // Proc of the 60th Annual Meeting of the Association for Computational Linguistics(Long Papers). Stroudsburg, USA: ACL, 2022, I: 2051-2064. [3] LI R F, CHEN H, FENG F X, et al. Dual Graph Convolutional Networks for Aspect-Based Sentiment Analysis // Proc of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Proce-ssing(Long Papers). Stroudsburg, USA: ACL, 2021, I: 6319-6329. [4] TAN X W, CAI Y, ZHU C X.Recognizing Conflict Opinions in Aspect-Level Sentiment Classification with Dual Attention Networks // Proc of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Stroudsburg, USA: ACL, 2019: 3426-3431. [5] 张文轩,殷雁君.用于方面级情感分析的图指导的差异化注意力网络.中文信息学报, 2023, 37(7): 102-113. (ZHANG W X, YIN Y J.Graph-Guided Differentiated Attention Network for Aspect-Level Sentiment Analysis. Journal of Chinese Information Processing, 2023, 37(7): 102-113.) [6] OH S, LEE D, WHANG T, ,et al. Deep Context and Relation-Aware Learning for Aspect-Based Sentiment Analysis // Proc of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Proce-ssing(Short Papers). Stroudsburg, USA: ACL, 2021, II: 495-503. [7] ZHOU Y X, LIAO L J, GAO Y, et al. To Be Closer: Learning to Link up Aspects with Opinions // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2021: 3899-3909. [8] CHEN C H, TENG Z Y, ZHANG Y.Inducing Target-Specific Latent Structures for Aspect Sentiment Classification // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2020: 5596-5607. [9] WANG K, SHEN W Z, YANG Y Y, et al. Relational Graph Attention Network for Aspect-Based Sentiment Analysis // Proc of the 58th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2020: 3229-3238. [10] CHAI H Y, YAO Z Y, TANG S Y, et al. Aspect-to-Scope Oriented Multi-view Contrastive Learning for Aspect-Based Sentiment Analysis // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2023: 10902-10913. [11] ZHAO X W, ZHOU Y, XU X J, et al. Extensible Multi-granularity Fusion Network for Aspect-Based Sentiment Analysis[C/OL].[2024-08-20]. https://arxiv.org/pdf/2402.07787. [12] ZHONG Q H, DING L, LIU J H, et al. Knowledge Graph Augmented Network towards Multiview Representation Learning for Aspect-Based Sentiment Analysis. IEEE Transactions on Knowledge and Data Engineering, 2023, 35(10): 10098-10111. [13] WANG H N, LU Y, ZHAI C X.Latent Aspect Rating Analysis without Aspect Keyword Supervision // Proc of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York, USA: ACM, 2011: 618-626. [14] JIANG L, YU M, ZHOU M, et al. Target-Dependent Twitter Sentiment Classification // Proc of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Techno-logies. Stroudsburg, USA: ACL, 2011: 151-160. [15] HU M T, ZHAO S W, ZHANG L, et al. CAN: Constrained Attention Networks for Multi-aspect Sentiment Analysis // Proc of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Stroudsburg, USA: ACL, 2019: 4601-4610. [16] FAN F F, FENG Y S, ZHAO D Y.Multi-grained Attention Network for Aspect-Level Sentiment Classification // Proc of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, USA: ACL, 2018: 3433-3442. [17] SONG Y W, WANG J H, JIANG T, et al. Targeted Sentiment Classification with Attentional Encoder Network // Proc of the 28th International Conference on Artificial Neural Networks. Berlin, Germany: Springer, 2019: 93-103. [18] LIU X Y, HOU R, GAN Y F, et al. Aspect-Oriented Opinion Alignment Network for Aspect-Based Sentiment Classification[C/OL].[2024-08-20]. https://arxiv.org/pdf/2308.11447. [19] SUN K, ZHANG R C, MENSAH S, et al. Aspect-Level Sentiment Analysis via Convolution over Dependency Tree // Proc of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Proce-ssing. Stroudsburg, USA: ACL, 2019: 5679-5688. [20] LIANG B, YIN R D, GUI L, et al. Jointly Learning Aspect-Focused and Inter-Aspect Relations with Graph Convolutional Networks for Aspect Sentiment Analysis // Proc of the 28th International Conference on Computational Linguistics. Stroudsburg, USA: ACL, 2020: 150-161. [21] ZHAO P L, HOU L L, WU O.Modeling Sentiment Dependencies with Graph Convolutional Networks for Aspect-Level Sentiment Classi-fication. Knowledge-Based Systems, 2020, 193. DOI: 10.1016/j.knosys.2019.105443. [22] TIAN Y H, CHEN G M, SONG Y.Aspect-Based Sentiment Ana-lysis with Type-Aware Graph Convolutional Networks and Layer Ensemble // Proc of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Stroudsburg, USA: ACL, 2021: 2910-2922. [23] JIANG T Y, WANG Z L, YANG M, et al. Aspect-Based Sentiment Analysis with Dependency Relation Weighted Graph Attention. Information, 2023, 14(3). DOI: 10.3390/info14030185. [24] FENG S, WANG B, YANG Z Y, et al. Aspect-Based Sentiment Analysis with Attention-Assisted Graph andVariational Sentence Representation. Knowledge-Based Systems, 2022, 258. DOI: 10.1016/j.knosys.2022.109975. [25] WANG Z H, ZHANG B, YANG R, et al. DAGCN: Distance-Based and Aspect-Oriented Graph Convolutional Network for Aspect-Based Sentiment Analysis // Proc of the Annual Conference of the North American Chapter of the Association for Computational Linguistics. Stroudsburg, USA: ACL, 2024: 1863-1876. [26] CHEN B F, OUYANG Q H, LUO Y Q, et al. S2GSL: Incorporating Segment to Syntactic Enhanced Graph Structure Learning for Aspect-Based Sentiment Analysis // Proc of the 62nd Annual Meeting of the Association for Computational Linguistics(Long Papers). Stroudsburg, USA: ACL, 2024: 13366-13379. [27] DEVLIN J, CHANG M W, LEE K, ,et al. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding // Proc of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies(Long and Short Papers). Stroudsburg, USA: ACL, 2019, I: 4171-4186. [28] VAN DER OORD A, LI Y Z, VINYALS O. Representation Lear-ning with Contrastive Predictive Coding[C/OL].[2024-08-20]. https://arxiv.org/pdf/1807.03748. [29] DONG L, WEI F R, TAN C Q, ,et al. Adaptive Recursive Neural Network for Target-Dependent Twitter Sentiment Classification // Proc of the 52nd Annual Meeting of the Association for Computational Linguistics(Short Papers). Stroudsburg, USA: ACL, 2014, II: 49-54. [30] YIN S, ZHONG G Q.TextGT: A Double-View Graph Transformer on Text for Aspect-Based Sentiment Analysis. Proceedings of the AAAI Conference on Artificial Intelligence, 2024, 38(17): 19404-19412.
2024, Vol. 37 
